Adaptive post-processing for mobile video calling system

ABSTRACT

A system may include a receiver, a decoder, a post-processor, and a controller. The receiver may receive encoded video data. The decoder may decode the encoded video data. The post-processor may perform post-processing on frames of decoded video sequence from the decoder. The controller may adjust post-processing of a current frame, based upon at least one condition parameters detected at the system.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims benefit under 35 U.S.C. §119(e) of U.S.Provisional Application Ser. No. 61/832,429, filed Jun. 7, 2013, whichis incorporated herein by reference in its entirety.

BACKGROUND

In communication systems with video displays, a video post-processingmay be applied after decoding encoded video data to improve visualquality of video image. Such post-processing, for example by filtering,may help remove visual artifacts caused by video coding and/orcompression. A typical filter's strength may be tuned to obtain goodtrade-off, in eliminating most visual artifacts while not blurring videoframes too much.

Fixed filtering strength or adjusted filtering strength based upon videocompression may be used for the post-processing. However, such level ofpost-processing may be insufficient.

Thus, there may be a need for an improved way of processing video datato improve visual quality more adaptively.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates a communication system according to an embodiment ofthe present disclosure.

FIG. 2 illustrates a decoding system according to an embodiment of thepresent disclosure.

FIG. 3 illustrates a coding system according to an embodiment of thepresent disclosure.

FIG. 4 illustrates a decoding method according to an embodiment of thepresent disclosure.

FIG. 5 illustrates a coding method according to an embodiment of thepresent disclosure.

DETAILED DESCRIPTION

FIG. 1 illustrates a simplified block diagram of a communication system100 according to an embodiment of the present invention. The system 100may include at least two terminals 110-120 interconnected via a network150. For unidirectional transmission of data, a first terminal 110 maycode video data at a local location for transmission to the otherterminal 120 via the network 150. The second terminal 120 may receivethe coded video data of the other terminal from the network 150, decodethe coded data and display the recovered video data. Unidirectional datatransmission may be common in media serving applications and the like.

FIG. 1 illustrates a second pair of terminals 130, 140 provided tosupport bidirectional transmission of coded video that may occur, forexample, during videoconferencing. For bidirectional transmission ofdata, each terminal 130, 140 may code video data captured at a locallocation for transmission to the other terminal via the network 150.Each terminal 130, 140 also may receive the coded video data transmittedby the other terminal, may decode the coded data and may display therecovered video data at a local display device.

In FIG. 1, the terminals 110-140 may be illustrated as servers, personalcomputers and smart phones but the principles of the present inventionmay be not so limited. Embodiments of the present invention findapplication with laptop computers, tablet computers, media playersand/or dedicated video conferencing equipment. The network 150represents any number of networks that convey coded video data among theterminals 110-140, including for example wireline and/or wirelesscommunication networks. The communication network 150 may exchange datain circuit-switched and/or packet-switched channels. Representativenetworks include telecommunications networks, local area networks, widearea networks and/or the Internet. For the purposes of the presentdiscussion, the architecture and topology of the network 150 may beimmaterial to the operation of the present invention unless explainedhereinbelow.

FIG. 2 may be a functional block diagram of a video decoding system 200according to an embodiment of the present invention.

The video decoding system 200 may include a receiver 210 that receivesencoded video data, a video decoder 220, a post-processor 230, acontroller 232 to manage operation of the system 200 and a display 234to display the decoded video data. The video decoder 220 may decodevideo sequence received. The post-processor 230 may performpost-processing on frames of decoded video sequence. The controller 232may adjust the post-processing of a current frame by the post-processor230, based upon one or more of condition parameters detected by thesystem 200.

The receiver 210 may receive video to be decoded by the system 200. Theencoded video data may be received from a channel 212. The receiver 210may receive the encoded video data with other data, for example, codedaudio data and/or ancillary data streams. The receiver 210 may separatethe encoded video data from the other data.

The video decoder 220 may perform decoding operation on the videosequence received from the receiver 210. The video decoder 220 mayinclude a decoder 222, a reference picture cache 224, and a predictionmode selection 226 operating under control of controller 228. Thedecoder 222 may reconstruct coded video data received from the receiver210 with reference to reference pictures stored in the reference picturecache 224. The decoder 222 may output reconstructed video data to thepost-processor 230, which may perform additional operations on thereconstructed video data to condition it for display. Reconstructedvideo data of reference frames also may be stored to the referencepicture cache 224 for use during decoding of subsequently received codedvideo data.

The decoder 222 may perform decoding operations that invert codingoperations performed by the video coder 330 (shown in FIG. 3). Thedecoder 222 may perform entropy decoding, dequantization and transformdecoding to generate recovered pixel block data.Quantization/dequantization operations may be lossy processes and,therefore, the recovered pixel block data likely will be a replica ofthe source pixel blocks that were coded by the video coder 330 (shown inFIG. 3) but may include some error. For pixel blocks coded predictively,the transform decoding may generate residual data; the decoder 222 mayuse motion vectors associated with the pixel blocks to retrievepredicted pixel blocks from the reference picture cache 224 to becombined with the prediction residuals. The prediction mode selector 226may identify a temporal prediction mode being used for each pixelblockof an encoded frame being decoded and request the needed data for thedecoding to be read from the reference picture cache 224. Reconstructedpixel blocks may be reassembled into frames and output to thepost-processor 230.

The post-processor 230 may perform video processing to condition therecovered video data for rendering, commonly at a display 234. Typicalpost-processing operations may include applying deblocking filters, edgedetection filters, ringing filters and the like. The post-processor 230may output recovered video sequence for rendering on the display 234 or,optionally, stored to memory (not shown) for later retrieval anddisplay. The controller 232 may manage operation of the system 200.

An exemplary post-processing operation may be described as follows. Asquare pixel region in the decoded image may be defined, and anorthogonal transform (such as discrete cosine transform (DCT)) may beapplied to obtain transformed coefficients. A hard thresholding may beperformed followed by inverse transform, a filtered version of thesquare pixel region may be obtained. Hard thresholding may be defined asa function or operation that may set a coefficient to zero if thecoefficient's absolute value may be lower than certain threshold value.

For multiple overlapped pixel regions taken from the decoded image, theabove operation may be repeated, to obtain filtered version of multiplepixel regions. The filtered pixel regions may be aggregated together byweighted averaging to generate an overall filtered image.

In the above post processing filtering operation, the threshold valueused in the hard thresholding step determines the strength of thefilter: the higher the threshold, the stronger filtering effect on theresulting image.

The perception of video quality may depend on many factors associatedwith the image capturing, the coding, the transmission, the reception,the decoding, and the playback of the video, for example: resolution andsettings used for compression, display size, display brightness, displayto user distance, user viewing angle relative to display, and ambientlight, existing filtering settings, etc. Additionally, power consumptionin video coding and decoding systems may be a concern. For example, whenpost processing does not provide a significant visual difference,post-processing filter may be turned off.

View random access (VRA) pictures or access units may be coded into abitstream. VRA coding enable allows for the decoding of a subset of theviews present in the bitstream. The views selected to be accessible inVRA pictures may be alternated in successive VRA pictures, such that allviews may be gradually reconstructed when two or more VRA pictures havebeen decoded.

In a mobile communication system, settings of the post-processing (suchas the threshold value) may be adaptively in various ways. For mobilecommunication system that uses VRA, the threshold value of the filtermay be adjusted to relatively higher for low VRA resolutions andrelatively lower for high VRA resolutions. With low VRA resolution,visual artifacts due to coding or compression may be scaled uprelatively in visual field of the decoded image, and thus become morevisible to human eyes. Therefore, stronger filtering at low VRAresolution to remove visual artifacts may be needed to suppress theseartifacts, for example to smooth out pixels with too much colorcontrast, even at the cost of removing some textures.

Screen size, display window size, screen resolution and viewing distancemay be condition parameters for adjusting the post-processing (forexample for adjusting a filter threshold value).

If the user is further away from the screen 234, he/she may be lesslikely to perceive the visual artifacts due to coding, therefore a lowerfilter threshold value in post processing may be applied. The ability ofhuman eyes to perceive visual artifacts due to coding may depend on the“pixel per degree (PPD)”, which may be influenced by multiple factors,such as screen size, screen resolution, and the distance from the screen234 to the viewing user. The filter threshold value may be set inreverse proportion to PPD, as it may be less likely to see visualartifacts due to coding if more pixels may be packed into a small space(more PPD), and thus a weaker filtering may be needed.

An exemplary filter threshold value may be represented as T=f(x)

If S, R, and D represent the screen physical size, the screenresolution, and the viewing distance respectively, an exemplary filterthreshold value may be represented by a monotone increasing functionthat may be tuned:

${T \propto {f\left( \frac{S}{B + D} \right)} \propto {{a*\left( \frac{S}{B + D} \right)} + b}},$

where a and b may be parameters used for tuning the adaptive filterthreshold value.

The system 200 may detect the above condition factors. The screenphysical size may be specified as a predefined hardware parameter storedin a memory in the system 200. The screen resolution may be a predefinedhardware parameter, or an actual video/image screen solution defined bythe video stream data, or a combination of both.

The viewing distance may represent the approximate distance between theviewing user's eyes and the screen 234 of the system 200. The viewingdistance may be determined or estimated by the system 200 via variousdifferent processes.

For example, during video conferencing, a user terminal may be receivingand displaying a first video from a different user terminal, whilecapturing and transmitting a second video. In such a case, the userterminal may use the captured image of the second video to perform realtime image processing (for example, face recognition), to determine orestimate the viewing distance, based upon the size of the recognizedface of the user in the captured real time video image. The viewingdistance, as determined real time from the second video, may be used inreal time to adjust the post-processing of the first video to bedisplayed on the user terminal.

Various different image processing or machine vision systems and methodsmay be used to determine the viewing distance. For example, the distancebetween the centers of the user's eyes in the captured image may beconsidered to be approximately inversely proportional to the viewingdistance of the screen 234 to the user. That is, closer the user's eyesare to each other in the image, the greater the viewing distance.Alternatively, other human facial geometries may be used to estimate theviewing distance.

Additionally, the system 200 may determine the viewing distance, byusing additional sensor data from sensors such as accelerometer, globalposition satellite (GPS), echo location sensor, electric field sensor,magnetic field sensor, depth camera, stereoscopic camera, light-fieldcamera, etc.

Other condition parameters affect the adaptive filter threshold valuemay include screen brightness and ambient light brightness at thedisplay terminal. If the display terminal (such as a mobile device) isunder direct and bright sun light, for example, it may be relativedifficult for the viewing user to see fine details in the image,including visual artifacts due to coding, as compared to when thedisplay terminal is displaying the image in a dark room. Thus, lessfiltering may be needed if the ambient light brightness is relativelyhigh. On the other hand, if the screen brightness is relatively high,visual artifacts may be more noticeable, and thus more filtering may beneeded.

If A and B represent the ambient light brightness and the screenbrightness respectively, an exemplary filter threshold value may berepresented by a monotone increasing function that may be tuned:

${T \propto {f\left( \frac{S}{B + D} \right)} \propto {{a*\left( \frac{S}{B + D} \right)} + b}},$

where c and d may be parameters used for tuning the adaptive filterthreshold value.

The ambient light brightness and the screen brightness may be determinedor estimated by the system 200 via various ways.

For example, the ambient light brightness may be estimated from detectedbrightness from optical sensors in the system 200, for example, a cameraused to capture video images during a video conference, or one or moreoptical switch, optical resistor, optical transistors designed togenerate signals varying intensity based upon ambient light intensity.

A camera may capture the video image of the user, and the system 200 maydetermine the ambient light brightness from the pixel brightness of thecaptured video image of the user. The system 200 may specificallydetermine ambient light brightness from only some portions of thecaptured video image of the user. For example, the background scenebehind the user may be extremely bright, while the user's face or eyesmay be positioned in a shadow. In such a case, the user may be viewingthe display from a shadow, and from his/her point of view, the ambientlight brightness may be considered to be relatively low. Thus, thesystem 200 may determine that only the pixel brightness of the user'sface in the image, particularly near the user's eyes, is the relevantportion of the image to use for determining the relevant ambient lightbrightness.

Additionally, the system 200 may determine the ambient light brightnessbased upon other ambient light related factors calculated or estimatedfrom the captured image of the user's face, such as ambient light anglerelative to the viewing angle. For example, a uni-directional ambientlight shining perpendicular to the user's viewing angle would notsignificantly interfere with the user's perception of the displayedimage on the screen 234. Thus, if the system 200 determines from thecaptured image of the user's face that the ambient light is mostly froma direction perpendicular to the viewing direction, then the system 200may adjust post-processing to be relatively high, as compared to whenthe ambient light is determined to be mostly omni-directional (such asin natural sun light or under a flood light).

Furthermore, the system 200 may determine the ambient light brightnesspartly based upon the amount of light shining on or near the screen 234.If the user is positioned in a relatively dark location, but there is abright light shining directly on the screen 234 itself, then the usermay perceive a large amount of ambient light reflected from the surfaceof the screen 234. In such a case, the system may determine the ambientlight brightness to be relatively high, and adjust post-processing to berelatively low, as visual artifacts would not be very noticeable undersuch lighting conditions.

The system 200 may determine the screen brightness, i.e. the overallbrightness of light from the displayed image on screen 234, via variousways. For example, the system 200 may detect the hardware type of thescreen 234 (liquid crystal display (LCD), light emitting diode (LED),organic light emitting diode (OLED), etc.), driving signals (forexample, for backlighting) of the screen 234, and etc., to estimate orcalculate the current screen brightness of screen 234.

The exemplary adaptive filter threshold value function may be saved as aplurality of pre-calculated look-up values in a look-up table indexedaccording to multiple condition parameters such as S, R, and D above.Multiple adaptive filter threshold value functions may be saved in thelook-up table as different pre-tuned post-processing “policies” or“profiles”, such as for “movie quality” with more video smoothing, etc.

Additionally, the screen 234 at the display terminal may not be facingthe viewing user directly, i.e. where the screen surface is not orientedperpendicular to the viewing direction, or the screen surface is tiltedat some viewing angle relative to the viewing user. In such a condition,more pixels may be compacted into smaller viewing field, i.e. more PPD,visual artifacts may be less noticeable, and thus less filtering may beneeded.

In the above example for the viewing angle, the post-processing (forexample by filtering) may be adapted or adjusted according to the tiltdirection of the view angle. Specifically for example, if the screen 234is tilted in the horizontal direction relative to the viewing user, (forexample, the screen 234 is turned toward to the right of the user), PPDmay be compacted only in one specific dimension (for example here, thex-dimension), while the PPD may be unchanged in the directionperpendicular to the one specific dimension (for example here, they-dimension). In such a case, visual artifacts may be less noticeable inthe x-dimension, but more noticeable in the y-dimension. Thus, it may bedesirable to adjust the post-processing to be relatively less in the onespecific dimension (x-dimension), and/or relatively more in thedirection perpendicular to the one specific dimension (y-dimension).

The system 200 may determine the viewing angle via various ways.

For example, the system 200 may use a camera to capture an image of theuser's face, and estimate the viewing angle based upon the position andorientation of the user's face in the captured image.

Additionally, the system 200 may determine the viewing angle, by usingadditional sensor data from sensors such as accelerometer, globalposition satellite (GPS), echo location sensor, electric field sensor,magnetic field sensor, etc.

The viewing angle may also be estimated to determine a target imageregion, which the user may have focused his/her viewing attention to.The system 200 may use optical sensors, such as cameras, to calculatewhich portion of the screen 234 that the user may be focusing his/herviewing attention to in real time. The system 200 may selectively adjustpost-processing to be relatively high for the target image region of theuser's attention, thus increasing visual quality and removing visualartifacts in the image region of the user's attention, while reducingpost-processing for image regions outside of the user's attention. Inreal time, the user's attention may wander over different regions of theimage. The system 200 may record history of user's focused locations onthe screen 234, and reduce post-processing for image regions havinghistory of receiving little user viewing attentions.

Furthermore, the display terminal itself may contain components withexisting image processing, such as hardware image filtering. In such acase, it may be desirable to adjust the post-processing in the decodingsystem, by accounting for the existing image processing settings, so toavoid duplicative and non-useful image processing. If the displayterminal contains components with existing image processing, thedecoding system in the display terminal may determine the existing imageprocessing settings and adjust the post-processing to remove anyduplicative or superseding or similar image post-processing.

The video decoder 220 may perform decoding operations according to apredetermined protocol, such as H.263, H.264, MPEG-2, HEVC. In itsoperation, the video decoder 220 may perform various decodingoperations, including predictive decoding operations that exploittemporal and spatial redundancies in the encoded video sequence. Thecoded video data, therefore, may conform to a syntax specified by theprotocol being used.

In an embodiment, the receiver 210 may receive additional data with theencoded video. The additional data may include collected statistics onthe video frames or details on operations performed by the pre-processor320 (shown in FIG. 3). The additional data may be received via a channelestablished by the governing protocol for out-of-band data. For example,the receiver 210 may receive the additional data via supplementalenhancement information (SEI) channel and/or video usability information(VUI) channel. Alternatively, the additional data may be included aspart of the encoded video frames. The additional data may be used by thevideo decoder 220 and/or the post-processor 230 to properly decode thedata and/or to more accurately reconstruct the original video data.

FIG. 3 may be a functional block diagram of a video coding system 300according to an embodiment of the present invention.

The system 300 may include a video source 310 that provides video datato be coded by the system 300, a pre-processor 320, a video coder 330, atransmitter 340 and a controller 350 to manage operation of the system300. The controller 350 may control the pre-processor 320 to pre-processimage information from the video source 310, base upon one or morecondition parameters. The video coder 330 may code and compress thepre-processed image information into video data. The transmitter 340 maytransmit the video data.

The video source 310 may provide video to be coded by the system 300. Ina media serving system, the video source 310 may be a storage devicestoring previously prepared video. In a videoconferencing system, thevideo source 310 may be a camera that captures local image informationas a video sequence. Video data typically may be provided as a pluralityof individual frames that impart motion when viewed in sequence. Theframes themselves typically may be organized as a spatial array ofpixels.

The pre-processor 320 may perform various analytical and signalconditioning operations on video data. The pre-processor 320 may parseinput frames into color components (for example, luminance andchrominance components) and also may parse the frames into pixel blocks,spatial arrays of pixel data, which may form the basis of furthercoding. The pre-processor 320 also may apply various filteringoperations to the frame data to improve efficiency of coding operationsapplied by a video coder 330.

According to an embodiment, the system 300 may pre-process and/orcompress the image information for frames of the video sequence in realtime, based upon one or more condition parameters. The conditionparameters may be received (via receiver 370) or determined in real timefrom a target system 360 (not necessarily included in system 300) whichmay be receiving the transmitted video data from system 300. That is,the system 300 may pre-process and/or compress the image informationcaptured by system 300, based upon the conditions of display operationsof the target system 360, which may be decoding, post-processing, anddisplaying the video sequence from system 300. In other words, thetransmitting system 300 may perform pre-processing and/or compression ofthe image information based upon the conditions of the target system360. The controller 350 may receive the condition parameters viareceiver 370 from target system 360, and control the pre-processing ofimage in pre-processor 320, and/or control the compression and coding invideo coder 330, based on the condition parameters. The target system360 may include a decoding system 200 as illustrated in FIG. 2.

According to an embodiment, the condition parameters used by system 300may include the condition parameters stated above for post-processing insystem 200. The system 300 may perform pre-processing based on thecondition parameters, in similar relationships of the post-processingbased on the condition parameters. By performing the pre-processing inthis fashion, visual artifacts may be removed in system 300 beforecoding, and the decoding system 200 (in a target system 360) may reduceor remove post-processing. This may allow computation resourcerequirements to be shifted to the coding system 300 from the decodingsystem 200. Additionally, this shifting may be reversed from the codingsystem 300 to the decoding system 200. Moreover, a balance of sharedcomputation resource requirements may be achieved between the codingsystem 300 and the decoding system 200, based upon available computationresources at each end, thus allowing the coding system 300 topre-process and remove some of the visual artifacts, while the decodingsystem 200 to post-process and remove the remaining visual artifacts.

According to an embodiment, the system 300 may perform video compressionbased upon the condition parameters, in similar fashion as thepre-processing.

The video coder 330 may perform coding operations on the video sequenceto reduce the video sequence's bit rate. The video coder 330 may includea coding engine 332, a local decoder 333, a reference picture cache 334,a predictor 335 and a controller 336. The coding engine 332 may code theinput video data by exploiting temporal and spatial redundancies in thevideo data and may generate a datastream of coded video data, whichtypically has a reduced bit rate as compared to the datastream of sourcevideo data. As part of its operation, the video coder 330 may performmotion compensated predictive coding, which codes an input framepredictively with reference to one or more previously-coded frames fromthe video sequence that were designated as “reference frames.” In thismanner, the coding engine 332 codes differences between pixel blocks ofan input frame and pixel blocks of reference frame(s) that may beselected as prediction reference(s) to the input frame.

The local decoder 333 may decode coded video data of frames that may bedesignated as reference frames. Operations of the coding engine 332typically may be lossy processes. When the coded video data may bedecoded at a video decoder (not shown in FIG. 3), the recovered videosequence typically may be a replica of the source video sequence withsome errors. The local decoder 333 replicates decoding processes thatwill be performed by the video decoder on reference frames and may causereconstructed reference frames to be stored in the reference picturecache 334. In this manner, the system 300 may store copies ofreconstructed reference frames locally that have common content as thereconstructed reference frames that will be obtained by a far-end videodecoder (absent transmission errors).

The predictor 335 may perform prediction searches for the coding engine332. That is, for a new frame to be coded, the predictor 335 may searchthe reference picture cache 334 for image data that may serve as anappropriate prediction reference for the new frames. The predictor 335may operate on a pixel block-by-pixel block basis to find appropriateprediction references. In some cases, as determined by search resultsobtained by the predictor 335, an input frame may have predictionreferences drawn from multiple frames stored in the reference picturecache 334.

The controller 336 may manage coding operations of the video coder 330,including, for example, selection of coding parameters to meet a targetbit rate of coded video. Typically, video coders operate according toconstraints imposed by bit rate requirements, quality requirementsand/or error resiliency policies. The controller 336 may select codingparameters for frames of the video sequence in order to meet theseconstraints. For example, the controller 336 may assign coding modesand/or quantization parameters to frames and/or pixel blocks withinframes.

The transmitter 340 may buffer coded video data to prepare it fortransmission to the far-end terminal (not shown) via a communicationchannel 360. The transmitter 340 may merge coded video data from thevideo coder 330 with other data to be transmitted to the terminal, forexample, coded audio data and/or ancillary data streams (sources notshown).

The controller 350 may manage operation of the system 300. Duringcoding, the controller 350 may assign to each frame a certain frame type(either of its own accord or in cooperation with the controller 336),which may affect the coding techniques that may be applied to therespective frame. For example, frames often may be assigned as one ofthe following frame types:

An Intra Frame (I frame) may be one that may be coded and decodedwithout using any other frame in the sequence as a source of prediction.

A Predictive Frame (P frame) may be one that may be coded and decodedusing earlier frames in the sequence as a source of prediction.

A Bidirectionally Predictive Frame (B frame) may be one that may becoded and decoded using both earlier and future frames in the sequenceas sources of prediction.

Frames commonly may be parsed spatially into a plurality of pixel blocks(for example, blocks of 4×4, 8×8 or 16×16 pixels each) and coded on apixel block-by-pixel block basis. Pixel blocks may be coded predictivelywith reference to other coded pixel blocks as determined by the codingassignment applied to the pixel blocks' respective frames. For example,pixel blocks of I frames may be coded non-predictively or they may becoded predictively with reference to pixel blocks of the same frame(spatial prediction). Pixel blocks of P frames may be codednon-predictively, via spatial prediction or via temporal prediction withreference to one previously coded reference frame. Pixel blocks of Bframes may be coded non-predictively, via spatial prediction or viatemporal prediction with reference to one or two previously codedreference frames.

The video coder 330 may perform coding operations according to apredetermined protocol, such as H.263, H.264, MPEG-2, HEVC. In itsoperation, the video coder 330 may perform various compressionoperations, including predictive coding operations that exploit temporaland spatial redundancies in the input video sequence. The coded videodata, therefore, may conform to a syntax specified by the protocol beingused.

In an embodiment, the transmitter 340 may transmit additional data withthe encoded video. The additional data may include collected statisticson the video frames or details on operations performed by thepre-processor 320. The additional data may be transmitted in a channelestablished by the governing protocol for out-of-band data. For example,the transmitter 340 may transmit the additional data in a supplementalenhancement information (SEI) channel and/or a video usabilityinformation (VUI) channel. Alternatively, the video coder 330 mayinclude such data as part of the encoded video frames.

FIG. 4 illustrates a decoding method 400 according to an embodiment ofthe present disclosure.

At block 410, the system 200 may detect one or more condition parametersassociated with the operation of a display screen.

At block 420, the controller 232 may adjust the processing of a currentimage frame based on the one or more condition parameters.

At block 430, the post-processor 230 may perform the processing of thecurrent image frame.

FIG. 5 illustrates a coding method 500 according to an embodiment of thepresent disclosure.

At block 510, the system 300 may receive one or more conditionparameters associated with the operation of a display screen of anothersystem.

At block 520, the controller 350 may adjust the processing of a currentimage frame based on the one or more condition parameters.

At block 530, the pre-processor 320 may perform the processing of thecurrent image frame.

It may be appreciated that the disclosure may be not limited to thedescribed embodiments, and that any number of scenarios and embodimentsin which conflicting appointments exist may be resolved.

Although the disclosure has been described with reference to severalexemplary embodiments, it may be understood that the words that havebeen used may be words of description and illustration, rather thanwords of limitation. Changes may be made within the purview of theappended claims, as presently stated and as amended, without departingfrom the scope and spirit of the disclosure in its aspects. Although thedisclosure has been described with reference to particular means,materials and embodiments, the disclosure may be not intended to belimited to the particulars disclosed; rather the disclosure extends toall functionally equivalent structures, methods, and uses such as may bewithin the scope of the appended claims.

While the computer-readable medium may be described as a single medium,the term “computer-readable medium” includes a single medium or multiplemedia, such as a centralized or distributed database, and/or associatedcaches and servers that store one or more sets of instructions. The term“computer-readable medium” shall also include any medium that may becapable of storing, encoding or carrying a set of instructions forexecution by a processor or that cause a computer system to perform anyone or more of the embodiments disclosed herein.

The computer-readable medium may comprise a non-transitorycomputer-readable medium or media and/or comprise a transitorycomputer-readable medium or media. In a particular non-limiting,exemplary embodiment, the computer-readable medium may include asolid-state memory such as a memory card or other package that housesone or more non-volatile read-only memories. Further, thecomputer-readable medium may be a random access memory or other volatilere-writable memory. Additionally, the computer-readable medium mayinclude a magneto-optical or optical medium, such as a disk or tapes orother storage device to capture carrier wave signals such as a signalcommunicated over a transmission medium. Accordingly, the disclosure maybe considered to include any computer-readable medium or otherequivalents and successor media, in which data or instructions may bestored.

Although the present application describes specific embodiments whichmay be implemented as code segments in computer-readable media, it maybe to be understood that dedicated hardware implementations, such asapplication specific integrated circuits, programmable logic arrays andother hardware devices, may be constructed to implement one or more ofthe embodiments described herein. Applications that may include thevarious embodiments set forth herein may broadly include a variety ofelectronic and computer systems. Accordingly, the present applicationmay encompass software, firmware, and hardware implementations, orcombinations thereof.

The present specification describes components and functions that may beimplemented in particular embodiments with reference to particularstandards and protocols, the disclosure may be not limited to suchstandards and protocols. Such standards may be periodically supersededby faster or more efficient equivalents having essentially the samefunctions. Accordingly, replacement standards and protocols having thesame or similar functions may be considered equivalents thereof.

The illustrations of the embodiments described herein may be intended toprovide a general understanding of the various embodiments. Theillustrations may be not intended to serve as a complete description ofall of the elements and features of apparatus and systems that utilizethe structures or methods described herein. Many other embodiments maybe apparent to those of skill in the art upon reviewing the disclosure.Other embodiments may be utilized and derived from the disclosure, suchthat structural and logical substitutions and changes may be madewithout departing from the scope of the disclosure. Additionally, theillustrations may be merely representational and may not be drawn toscale. Certain proportions within the illustrations may be exaggerated,while other proportions may be minimized. Accordingly, the disclosureand the figures may be to be regarded as illustrative rather thanrestrictive.

One or more embodiments of the disclosure may be referred to herein,individually and/or collectively, by the term “disclosure” merely forconvenience and without intending to voluntarily limit the scope of thisapplication to any particular disclosure or inventive concept. Moreover,although specific embodiments have been illustrated and describedherein, it should be appreciated that any subsequent arrangementdesigned to achieve the same or similar purpose may be substituted forthe specific embodiments shown. This disclosure may be intended to coverany and all subsequent adaptations or variations of various embodiments.Combinations of the above embodiments, and other embodiments notspecifically described herein, will be apparent to those of skill in theart upon reviewing the description.

In addition, in the foregoing Detailed Description, various features maybe grouped together or described in a single embodiment for the purposeof streamlining the disclosure. This disclosure may be not to beinterpreted as reflecting an intention that the claimed embodimentsrequire more features than may be expressly recited in each claim.Rather, as the following claims reflect, inventive subject matter may bedirected to less than all of the features of any of the disclosedembodiments. Thus, the following claims may be incorporated into theDetailed Description, with each claim standing on its own as definingseparately claimed subject matter.

The above disclosed subject matter may be to be considered illustrative,and not restrictive, and the appended claims may be intended to coverall such modifications, enhancements, and other embodiments which fallwithin the true spirit and scope of the present disclosure. Thus, to themaximum extent allowed by law, the scope of the present disclosure maybe to be determined by the broadest permissible interpretation of thefollowing claims and their equivalents, and shall not be restricted orlimited by the foregoing detailed description.

What may be claimed:
 1. A system comprising: a receiver receivingencoded video data; a decoder decoding the encoded video data; apost-processor post-processing on frames of decoded video sequence fromthe decoder; and a controller adjusting post-processing of a currentframe, based upon at least one condition parameters detected at thesystem.
 2. The system of claim 1, wherein the receiver separates encodedvideo data from ancillary data streams.
 3. The system of claim 1,wherein the post-processing by the post-processor comprises at least oneof applying deblocking filters, applying edge detection filters, andapplying ringing filters.
 4. The system of claim 1, wherein thepost-processing by the post-processor comprises a transform of a squarepixel region based upon a coefficient threshold.
 5. The system of claim4, wherein the coefficient is adjusted by the controller based upon thecondition parameters detected at the system.
 6. The system of claim 5,wherein the condition parameters comprises at least one of a displaysize, a display resolution, a distance between a user and a display, aviewing angle of user relative to surface of the display, ambient lightamount, and hardware filter settings.
 7. The system of claim 5, whereinthe condition parameters are determined by the system via at least oneof video imagining of a user, ambient light detector, accelerometer,GPS, echo location sensor, electric field sensor, magnetic field sensor,depth camera, stereoscopic camera, and light-field camera.
 8. A methodcomprising: receiving, by a receiver, encoded video data; decoding, by adecoder, the encoded video data; post-processing, by a post-processor,on frames of decoded video sequence from the decoder; and adjusting, bya controller, post-processing of a current frame, based upon at leastone condition parameters detected at a system.
 9. The method of claim 8,wherein the receiver separates encoded video data from ancillary datastreams.
 10. The method of claim 8, wherein the post-processing by thepost-processor comprises at least one of applying deblocking filters,applying edge detection filters, and applying ringing filters.
 11. Themethod of claim 8, wherein the post-processing by the post-processorcomprises a transform of a square pixel region based upon a coefficientthreshold.
 12. The method of claim 8, wherein the coefficient isadjusted by the controller based upon the condition parameters detectedat the system.
 13. The method of claim 12, wherein the conditionparameters comprises at least one of a display size, a displayresolution, a distance between a user and a display, a viewing angle ofuser relative to surface of the display, ambient light amount, andhardware filter settings.
 14. The method of claim 12, wherein thecondition parameters are determined by the system via at least one ofvideo imagining of a user, ambient light detector, accelerometer, GPS,echo location sensor, electric field sensor, magnetic field sensor,depth camera, stereoscopic camera, and light-field camera.
 15. Anon-transitory computer readable medium, storing instruction codes,executable by a processor in a system to perform: receiving, by areceiver, encoded video data; decoding, by a decoder, the encoded videodata; post-processing, by a post-processor, on frames of decoded videosequence from the decoder; and adjusting, by a controller,post-processing of a current frame, based upon at least one conditionparameters detected at the system.
 16. The non-transitory computerreadable medium of claim 15, wherein the post-processing by thepost-processor comprises at least one of applying deblocking filters,applying edge detection filters, and applying ringing filters.
 17. Thenon-transitory computer readable medium of claim 15, wherein thepost-processing by the post-processor comprises a transform of a squarepixel region based upon a coefficient threshold.
 18. The non-transitorycomputer readable medium of claim 15, wherein the coefficient isadjusted by the controller based upon the condition parameters detectedat the system.
 19. The non-transitory computer readable medium of claim18, wherein the condition parameters comprises at least one of a displaysize, a display resolution, a distance between a user and a display, aviewing angle of user relative to surface of the display, ambient lightamount, and hardware filter settings.
 20. The non-transitory computerreadable medium of claim 18, wherein the condition parameters aredetermined by the system via at least one of video imagining of a user,ambient light detector, accelerometer, GPS, echo location sensor,electric field sensor, magnetic field sensor, depth camera, stereoscopiccamera, and light-field camera.